Listing of Claims 



1. -24. (Canceled) 

25. (Currently Amended) A conversational computing system, comprising: 

a multi-modal CUI (conversational user interface) manager, operatively connected to a 
plurality of I/O (input/output) Tenderers, which can receive input queries and input events across 
different user interface modalities of one or more different active applications and generate 
output messages and output events in connection with the one or more active applications in one 
or more of the different user interface modalities; 

a conversational kernel for generating multi-modal dialogs in response to the input 
queries and input events, and for managing context associated with the one or more active 
applications; and 

a conversational API (application program interface) for providing an interface between 
the on e or mor e active applications and the conversational kernel. 

26. (Original) The system of claim 25, further comprising: 
a conversational engine API; and 

a plurality of conversational engines, wherein the conversational kernel controls and 
accesses the conversational engines through the conversational engine API. to process the input 
queries and input events and to generate the multi-modal dialog and output events. 

27. (Original) The system of claim 25, wherein the conversational kernel provides 
conversational services and behaviors that are accessible by an application through the 
conversational API. 

28. (Original) The system of claim 27, wherein the conversational services and behaviors 
comprise one of conversational security, conversational customization, conversational search, 
conversational selection, conversational help, conversational memorization, conversational 
summarization, conversational agents, conversational formatting, conversational prioritization, 



conversational re-direction, conversational categorization, conversational abstraction and object 
management, conversational navigation, conversational undo, and a combination thereof. 

29. (Original) The system of claim 25, wherein the conversational API comprises a 
library comprising library functions of conversational foundation classes (CFCs) and 
fundamental dialog components, wherein the CFCs and fundamental dialog components are 
accessible through the library for constructing conversational objects, wherein the conversational 
objects are employed for one of performing conversational procedures and building 
conversational applications. 

30. (Original) The system of claim 29, wherein the CFCs can share context and be 
activated in parallel within an application or across a plurality of applications. 

31. (Original) The system of claim 30, wherein the CFCs and fundamental dialog 
components comprise one of CUI building blocks, conversational platform libraries, dialog 
modules, dialog scripts, beans, conversational gestures, and a combination thereof. 

32. (Original) The system of claim 3 1, further comprising a conversational browser, 
wherein the CFCs, dialog components, CUI building blocks, conversational platform libraries, 
dialog modules, dialog scripts, beans, conversational gestures, and conversational API are loaded 
into the system through CML (conversational markup language) pages that are processed via the 
conversational browser. 

33. (Original) The system of claim 29, wherein the conversational objects are 
implemented one of declaratively, imperatively and a combination thereof. 

34. (Original) The system of claim 25, wherein the conversational kernel is a platform 
that executes on top of one of an operating system, a real-time operating system, a virtual 
machine and a browser. 
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35. (Original) The system of claim 25, wherein the conversational kernel executes as an 
operating system service layer. 

36. (Original) The system of claim 25, wherein the system executes on one of a personal 
computer platform, a server platform, an embedded client device platform and a distributed 
combination of these platforms. 

37. (Original) The system of claim 25, further comprising: 
a plurality of I/O resources; and 

an I/O API for interfacing with the plurality of I/O resources and for registering the 
plurality of I/O resources with the conversational kernel. 

38. (Original) The system of claim 37, wherein the conversational kernel comprises a 
conversational transcoder for providing adaptation of the behavior, CUI and dialog presented to a 
user based on capabilities of the I/O resources and conversational engines. 

39. (Original) The system of claim 37, wherein the I/O API layer comprises one of I/O 
abstractions, user interface abstractions, device abstractions and a combination thereof. 

40. (Original) The system of claim 26, wherein the conversational engines comprise 
NLU (natural language understanding) and NLG (natural language generation) engines, and 
wherein the multi -modal dialogs comprise NLU and NLG dialogs. 

41. (Original) The system of claim 40, wherein the conversational kernel provides 
support at the dialog management level for NL (natural language) and use of context for 
disambiguation and mixed initiative. 

42. (Original) The system of claim 25, wherein the conversational kernel comprises: 

■ 

a dialog manager for managing dialog across active applications and for selecting an 
active dialog, context and application based on input queries; 
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a resource manager for managing and allocating conversational engines that are used 
during execution of conversational tasks; 

a conversational task dispatcher for coordinating and dispatching conversational tasks; 

and 

a context stack for accumulating a context of an active discourse of a conversational task, 
the context comprising query arguments, a list of attribute value - uples and conversational state. 

43. (Original) The system of claim 42, wherein the context stack comprises a global 
history of context. 

44. (Original) The system of claim 42, wherein the context stack comprises a meta- 
information repository. 

45. (Origi nal) The system of claim 44, wherein the meta- information repository 
comprises a-priori known information. 

46. (Original) The system of claim 44, further comprising a meta information manager 
for managing the meta-information repository, wherein the meta- information comprises a 
plurality of abstract categories associated with elements comprising one of files, directories, 
objects, data stream handles, networks, peripherals, hardware, applications, networked file 
systems and a combination thereof. 

47. (Original) The system of claim 46, wherein the meta-information is used to provide 
shortcuts to the elements. 

48. (Original) The system of claim 46, wherein a user can na vigate the categories of the 
meta- information through multi-modal conversational dialogs that comprise filling sets of 
attribute values out of a set of possible query types, and wherein the user can refine or modify the 
result of current navigation queries based on similarities of the corresponding categories. 
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49. (Original) The system of claim 46, wherein the meta-information provides a-priori 
knowledge information for the categories of meta-information. 



50. (Original) The system of claim 44, wherein the meta-information comprises user 
meta- information representing one of user preferences, security, habits, biometrics, behavior and 
a combination thereof. 

5 1 . (Original) The system of claim 50, wherein the user meta-information is one of 
provided directly by the user, learned from past usage of the system by the user, and a 
combination thereof. 

52. (Original) The system of claim 42, wherein the conversational kernel further 
comprises a back- end abstraction layer for accessing back-end logic via the dialog manager. 

53. (Original) The system of claim 25, further comprising a communication stack that 
implements conversational protocols for exchanging information with a conversationally aware 
system, wherein the conversationally aware system comprises one of a remote application, a 
remote device, a remote conversational computing system, and a combination thereof. 

54. (Original) The system of claim 53, wherein the conversational protocols comprise 
distributed conversational protocols for exchanging information comprising one of 
conversational state, conversational arguments, context, conversational engine API calls, results, 
and a combination thereof. 

55. (Original) The system of claim 53, wherein information exchanged between 
applications through the conversational protocols comprises a description of a conversational 
state of the applications, wherein the information representing a conversational state comprises 
one of a grammar, a vocabulary, acoustic models, language models, prompts, synthesis details, 
parsing details, tagging details, information to manage the dialog, and a combination thereof. 
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56. (Original) The system of claim 53', wherein information exchanged through the 
conversational protocols comprises a modality-independent description of an interlace of a 
remote control unit, wherein the interface allows the user to remotely control a conversationally 
aware appliance though the remote control unit. 

57. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational discovery protocols for automatically discovering the conversationally aware 
systems, and wherein the information exchanged through the conversational discovery protocols 
comprises broadcast requests for handshake, exchange of identifiers, exchange of hand les for 
first registration and exchange of handles for first negotiation. 

58. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational negotiation protocols for exchanging information to negotiate network topology 
between the system and a conversationally aware system. 

59. (Original) The system of claim 53, wherein the conversational protocols comprise 
conversational registration protocols for exchanging registering information, wherein the 
registering information comprises one of conversational capabilities, conversational state, 
context, and a combination thereof. 

60. -96. (Canceled) 

97. (Currently Amended) A computer readable medium having stored thereon a set of 
instructions that are executable by a computer to implement a conversational virtual machine, 
the conversational virtual machine comprising:: 

a kernel adapted to manage dialog and context, conversational engines and resources and 
communication across different platforms, applications, devices or combinations thereof, each 
having one or more different user interface modalities, to provide a coordinated, universal 
conversational user interface (GUI) across the different user interface modalities; and 
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an API (application program interface) comprising abstractions adapted to access 
conversational services from the kernel on behalf of said platforms, applications, and devices or 
combinations thereof. 

98. (Currently Amended) The computer readable medium conversational virtual machine 
of claim 97, wherein the conversational virtual machine is compris e s a shell that executes on top 
of one of an operating system, a real-time operating system, a virtual machine, and a 
conversational browser. 

99. (Currently Amended) The computer readable medium conversational virtual machine 
of claim 97, wherein the conversational virtual machine executes as an operating system service 
layer. 

100. (Currently Amended) The computer readable medium conversational virtual 
machin e of claim 97, further comprising an engine API comprising abstractions adapted to access 
a conversational engine. 

101. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97, wherein the API comprises a plurality of conversational foundation classes 
that are accessible through library functions for building one of conversationally aware 
applications, dialog components for performing specific reusable dialog tasks, and both. 

102. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 101, wherein the conversational foundation classes comprise conversational 
gestures that characterize a modality-independent dialog. 

103. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97, wherein the conversationally aware applications and dialog components are 
implemented one of declaratively, imperatively, and a combination thereof. 
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104. (Currently Amended) The com puter readable medium conversational virtual 
machin e of claim 97, wherein the kernel comprises a task manager adapted to drive a 
conversational engine and a task, process or thread running on the conversational virtual 
machine. 

105. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97, wherein the kernel comprises: 

a resource manager adapted to manage one of local resources, distributed resources, and 
both; and 

an input/output (I/O) manager adapted to manage multi-modal I/O events. 

106. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97, wherein the kernel comprises: 

a dialog manager adapted to manage conversational dialog across registered applications; 

and 

a context stack for maintaining the context of an active application or task under the 
control of the dialog manager. 

107. (Currently Amended) The computer readable medium conv e rsational virtual 
maefeme of claim 106, wherein the kernel further comprises an arbitrator for arbitrating a target 
application of an I/O event between the registered applications. 

108. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 106, wherein the API comprises conversational protocols adapted to provide 
distribution of the conversational virtual machine. 



109. (Currently AmendedVThe computer readable medium conversational virtual 
machine of claim 108, wherein the distribution of the conversational virtual machine comprises 
distribution of functions and components of the conversational virtual machine across multiple 



devices or resources that collectively contribute to providing a complete functionality of the 
conversational virtual machine. 

1 10. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 108, wherein the distribution of the conversational virtual machine comprises 
distribution of functions of the conversational virtual machine among a plurality of 
conversational virtual machines. 

111. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 1 10, wherein the role of each of the plurality of conversational virtual machines 
is dynamically negotiated between the conversational virtual machines. 

112. (Currently Amended) The computer readable medium conversational virtual 
machin e of claim 108, wherein the distribution of the conversational virtual machine comprises 
distribution of the dialog manager and context stack across the registered applications. 

113. (Currently Amended^ The computer readable medium conversational virtual 
machin e of claim 108, wherein the conversational protocols comprise conversational distributed 
protocols adapted to allow coordination of a dialog among a plurality of applications and devices. 

1 14. (Cuircntly Amended) The computer readable medium conversational virtual 
machine of claim 1 13, wherein the plurality of applications and devices comprise si lent partners. 

115. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 108, wherein the conversational protocols comprise negotiation protocols 
adapted to allow the kernel to dynamically negotiate one of a master/slave, a client/server, and a 
peer-to-peer topology with at least one kernel of a remote conversational virtual machine. 

116. (Canceled) 
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1 17. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97 444, wherein thd eo^M^s^ou^vijtu^ machine program code comprises 
instructions for transcrihesiag input events into ASCII input streams and processesmg-the ASCII 
input streams as objects. 



118. (Currently Amended) The computer readable medium conversational virtual 
machin e of claim 1 17, wherein the ASCII input streams comprise a list of attribute- value n-uples. 

1 19. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97 444, wherein the conversational virtual machine program code comprises 
instructions for comparing compares dialogs with conversational logic. 

120. (Currently Amended) The computer readable medium conv e rsational virtual 
machine of claim 1 19, wherein the conversational logic comprises logic statements including one 
of true, false, incomplete, ambiguous, different/equivalent for A SCII comparison, 
different/equivalent for NLU-converted query comparison, different/equivalent for active query 
field comparison, unknown, incompatible, incomparable, and a combination thereof. 

121. (Currently Amended) The computer readable medium conversational virtual 
machine of claim 97, wherein the conversational virtual machine is implemented as an interface 
for a UCRC (universal conversational remote control), wherein the UCRC is used to control 
home appliances that are conversationally aware. 

122. (Currently Amended) The computer readable medium conversational virtual 
machin e of claim 121, wherein the UCRC comprises a speech- enabled PDA (personal digital 
assistant) device. 

123. -124. (Canceled) 
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